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Abstract. Discrete-time discrete-state random Markov chains with a tridiag- 
onal generator are shown to have a random attractor consisting of singleton 
subsets, essentially a random path, in the simplex of probability vectors. The 
proof uses the Hilbert projection metric and the fact that the linear cocycle 
generated by the Markov chain is a uniformly contractive mapping of the pos- 
itive cone into itself. The proof does not involve probabilistic properties of the 
sample path u> and is thus equally valid in the nonautonomous deterministic 
context of Markov chains with, say, periodically varying transitions probabili- 
ties, in which case the attractor is a periodic path. 

1. Introduction. Markov chains with a tridiagonal generator are common in bi- 
ological applications, see, e.g., [1, 13, 21]. Their asymptotic behaviour is well un- 
derstood when the transitions probabilities are constant, i.e, the Markov chain is 
homogeneous or, equivalently, autonomous in the language of dynamical systems. 
In this paper we consider the case where the transitions probabilities can vary in 
time, e.g., periodically, or randomly due to a periodically or randomly changing 
environment. The Markov chains are then nonautonomous or random dynamical 
systems [2, 8, 15] and the concepts of autonomous dynamical systems such as equi- 
libria are inadequate. Thus a new concept of nonautonomous or random attractors 
is needed. 

The results in this paper are presented in the context of random Markov chains 
and random dynamical systems, although the proofs are do not depend at all on 
probabilistic properties of the sample path parameter ui and are thus equally valid in 
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the nonautonomous deterministic context of Markov chains with, say, periodically 
varying transitions probabilities. 

Tridiagonal Markov chains, both deterministic and random, are presented in 
Section 2. The long term dynamical behaviour of the autonomous deterministic 
case is then given for completeness in Section 3, although it follows as a special case, 
because it provides useful background information for the random case. The proof 
uses the fact that random Markov chains generate contractive linear cocycles which 
map a positive cone into itself. First, in Section 4, a general theorem on existence 
of a random attractor with singleton subsets in a metric space is formulated and 
proved. The assumptions seem rather restrictive at the first sight, but are just 
what is needed later. Then, in Section 5 some preliminaries from the theory of 
positive linear operators are recalled, the essence of which is that in a quite a 
general situation, for linear maps positive with respect to the same invariant cone, 
there exists a common metric, the Hilbert projective metric, in which all these linear 
mappings are uniformly contractive. Finally, in Section 6, it is shown that the linear 
cocycles generated by the random Markov chains in Section 2 satisfy the conditions 
of the abstract theorem from Section 4 under uniform upper and lower positivity 
bounds on the tridiagonal transitions probabilities and thus have a random attractor 
consisting of singleton subsets. The random attractor is essentially a randomly 
varying path in the simplex of probability vectors which pathwise attracts all other 
iterates of the Markov chain. In the nonautonomous deterministic setting with 
periodical transitions probabilities it is a periodic path. 

There is an extensive literature on products of random Markov chains, see e.g., 
[10, 11, 12, 17, 18, 22]. Although the problem investigated here does not seem to 
have been addressed directly as such yet in the literature, the results could probably 
be obtained by extending the proofs in [11, 22] after similar computations to those 
that are needed below. The proof given here is preferable since it is direct and 
is written in the language of random dynamical systems. In particular, the paper 
demonstrates that the effect of a random attractor to be singleton is valid not only 
for some classes of monotone random systems, as it is reported earlier in [9], but 
also for the class of random Markov chains studied below. 

2. Tridiagonal Markov chains in biological models. Markov chains with tridi- 
agonal transition matrices are common in biological models, for example, birth-and- 
death processes [1], cell-cell communication [13] and cancer dynamics [21], to name 
just a few. 

To fix ideas, consider the distance d(t n ) between two cells at time t n = nA, 
which is supposed to take discrete values in {1, ...,N}, essentially the distance 
that they can move in one unit of time, where d(t n ) can stay unchanged or change 
to d(t n ) ± 1 with certain probabilities. This can be formulated as an N state 
discrete-time Markov chain with states {1, . . . , N} corresponding to the value of 



Let p(t n ) — {pi(t n ), . . . ,PN{tn)) T be the probability vector for the state of the 
system at time t n . The dynamics are described by the system of difference equations 



Pi{t n +i) = [1 - <jiA]pi(t n ) + g 2 P2(t n )A 

Pj(tn+l) = q2j-3Pj-l(tn)A+ [1 - (<?2j-2 + Q2j-l) A] Pj(t n ) + q 2 j P J + 1 (t n ) A, 



d(t n ). 



J 



1=2,..., 



N-l, 



PN{t n +l 



) 



q2N-3PN-l(tn)& + [1 - q2N-2^\PN(tn), 
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where 

qj >0, j = l,...,2N-2, 
and the pj satisfy the probability constraints 

N 

J2pj =1 > Pi>°> i = l,...,JV 

3=1 

This is a vector-valued difference equation 

p(t n+1 ) = [I N + AQ]p(t n ) 
on the simplex Ejy in R w defined by 

T N = <p = (px, ■ ■ ■ ,p N ) T : = 1, Pi, ■ . ■ ,Pn G [0, 1] y 

where In is the N x N identity matrix and Q is the tridiagonal N x iV-matrix 

-9i 92 O 

9i -(92 + 93) 94 

.1) 

92A-5 —(92^-4 + 92^-3) 927V-2 
O 92N-3 — 92W-2 

This is a discrete-time finite-state Markov chain 

= [/jv + AQ] (2) 

with the transition matrix [In + AQ]. It is a first order linear difference equation 
on Ejv corresponding to the Euler numerical scheme for the ordinary algebraic- 
differential equation 

dp 

— = Qp, peSjv, 
with the constant time step A > 0. 

2.1. Random Markov chains. Let (fl, J 7 , P) be a probability space and suppose 
now that the coefficients in the Q matrix are random, i.e., the qj : — ¥ M are T- 
measurable mappings or, equivalently, Q : £1 — > M. NxN is an ^-measurable N x TV- 
matrix valued mapping. 

This corresponds to a random environment, which is supposed to vary or be 
driven by a stochastic process modelled by a metrical (i.e., measurable) dynamical 
system O = {9 ni n G Z} on il generated by a bi-measurable invertible mapping 
9 : fl — > fl. In particular, satisfies Oquj = ui and 

Qm+nu = ^m(^), V m,n G Z, u e fl. 

See Arnold [2] for more information. 

Define := In + AQ(uj) and assume that A > is sufficiently small, so that 
the eigenvalues of each matrix for given uj lie in the unit disc of the complex plane 
(see next section). 

This gives the random Markov chain 

P {n+1) = ifl» w p (n) , (3) 
which is a random linear difference equation on T,n, see [2, 8, 14] for random 
difference equations. The iterates of (3) are random probability vectors in E^r, i.e., 
J 7 - measurable mappings p : il — > Tin- 
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3. Dynamical behaviour: deterministic case. It is well-known that, under cer- 
tain nondegeneracy conditions, the "deterministic" Markov chain (2) has a unique 
equilibrium state which is globally asymptotically stable in Sjv- This result fol- 
lows as a special case of the main result of this paper below. A direct proof using 
elementary methods will now be given, since it also provides useful background 
information for the general "random" case. 

Let ljv be the column vector in M. N with all components equal to 1. Then 

l£<2 = o, (4) 

i.e. each column of Q adds to zero. Moreover, 1 n In — ljv, so Ijv is a left eigen- 
vector corresponding to eigenvalue A = 1 of the matrix In + AQ. Note that the 
matrix 7jy + AQ is a stochastic matrix. 

The Perron- Frobenius theorem applies to the matrix La '■= In + AQ when 
A > is chosen sufficiently small. In particular, it has eigenvalue A — 1 and there 
is a positive eigenvector x which can be normalized (in the || • norm) to give a 
probability vector p, i.e. [Ijv + AQ]p = p, so Qp = 0. In fact, we can show these 
properties directly for the given matrix. 

One can solve Qx — uniquely in (up to a scalar multiplier) since by 
assumption the qj > 0. Specifically, 

x j+ i = j = 1,.-.,N- 1. 

Taking X\ — \ yields 

j 

^3+^=\\-^-i 3 = 1,...,N- 1, 
1 1 q2i 



i=l 

and, hence, the probability vector 



p i = ^T' 3 = 1,.. .,N- 



where 



N N-l j 



.|*||! =2^=1+ £11 „ 

j = l j = l i=l HA 

The corresponding Markov chain is, in fact, ergodic since by assumption all the qj 
are positive. In particular, when qzj-i = 92j for each j, then p is the uniformly 
distributed probability vector with identical components p i = i = 1, . . . , JV. 

Theorem 3.1. Let > for j = 1, 2, . . . , 2iV — 2. TTien i/ie probability eigenvec- 
tor p is an asymptotically stable steady state of the difference equation (2) on the 
simplex E n ■ 

Proof. First note that by Geshgorin's theorem applied to columns the eigenvalues of 
the matrix Q lie in the union of the closed discs centered on —q% + Oi, . . . , —92^-2 — 
qij-\ +Ck, . . . , — <Z2V-2 + Ch in the complex plane with respective radii q±,..., 92^-2 + 
<72j-i, ■ ■ ■ , 92V-2- These all contain the origin 0+Ck on their boundary, but otherwise 
lie in the negative real part of the complex plan. It is already known that is an 
eigenvalue, so all other eigenvalues have strictly negative real parts. Moreover, is 
a simple eigenvalue with the positive eigenvector p. 

It is easy to show that no generalized eigenvectors exist, since one would satisfy 
the equation Qx = Ox + p, i.e., Qx = p, which is impossible since the sum of 
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components on the left hand side is equal to 0, while the sum on the right side is 
equal to 1. 

It follows that p is an eigenvector of the matrix L = In + AQ corresponding 
to the simple eigenvalue A = 1. Moreover, if A is small enough, then all other 
eigenvalues of the matrix L lie inside the unit disc in the complex plane, i.e., satisfy 
|A| < 1. It then follows that all solutions p^ of the difference equation (2) on E^r 
converge to p. 

This can be shown by adapting the proof of Theorem 10.9 in [19]. Consider the 
Jordan canonical decomposition LQ — QJ, where Q is the matrix of eigenvectors 
and generalized eigenvectors of the matrix L with p as its first column corresponding 
to a 1 x 1 Jordan block [1] and the other Jordan blocks corresponding to the other 
eigenvalues with |A| < 1. Then J k converges to an N x N matrix Z with Z\,\ = 1 
and all other components z%j = 0. This implies that 

iV 0) = QJ k Q- l p^ -> QZQ" V°J 

for any p(°) G H N . Now QZ = [p|0| . . . |0], so QZQ~ l p^ is a scalar multiple of 
p. But L maps £jv hito itself, so this scalar multiple of p is, in fact, p itself, i.e., 
^fep(o) p a s fc — !• cx) for all p (0) G T, N . □ 

4. Random attractors of uniformly contracting cocycles. Let M be a com- 
plete metric space equipped with the metric p. 

Definition 4.1. A map F : Z + X fi X M — > M is called a (discrete-time) cocycle 
on M with respect to the driving system Q if it satisfies the initial condition 

F(Q,u>,x) = x, i e M, w e fi, 

and the cocycle property 

F(n + m,uj,x) — F(n,9 m uj,F(m,uj,x)), x G M, uj G f2, ra,n£Z + . (5) 

The pair (G, F) is called a (discrete-time) random dynamical system in [2]. 

Define f(uj,x) :— F(l,u),x). Then, clearly, due to cocycle property (5) for any 
n G Z + the map F(n, uj, x) can be expressed as a superposition of maps f(ui, x) for 
different ui and x: 

F(n, uj, x) = f(6 n -iu, F(n -l,u,x)) = /(#„-i^, . . . f(0 lU , f(9 u, x))...). (6) 

The map f(uj,x) is called the generator of the cocycle F(n,uj,x). 

In what follow it will be supposed that the cocycle F(n,u>,x) is continuous in x 
for every n G Z + and uj G fl. By (6) the cocycle F(n,ui, x) is continuous in x if its 
generator f(uj,x) is continuous in x for every w G f2. 

An ^-measurable family ^ = {A u ,uj G fi} of nonempty compact subsets of M 
is the family of image sets of an .F-measurable set valued mapping uj t-¥ A u , i.e., 
for which the real valued mapping uj h- > dist p (x,A LJ ) is ^-measurable for each x G 
M, see [4, Theorem 8.1.4]. It is called f -invariant if f(u),A u ) — Ag^, and hence 

F(n,uj, AJ) = Ae nU , uj g O, n G Z+. 

Recall that the Hausdorff separation, or semi-metric, H*(X, Y), of the nonempty 
compact subsets AT and Y of M is defined by 

H*AX,Y) := maxdist p (x, Y), 
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where dist p (a;,Y~) := min yg y p(x, y) 7 and the Hausdorff metric H p (X,Y) for the 
nonempty compact subsets X and Y of M is 

H p (X,Y) :=m^{H;(X,Y),H;(Y,X)} . 

Finally, the diameter of a subset X of M is defined by diam(A) := sup^, yeX p(x, y). 

Definition 4.2. An ^-measurable family stf = {A^^lj € 0} of nonempty compact 
subsets of M is called a random attractor if it (i) is F-invariant, (ii) pullback 
attracts nonempty bounded subsets of M, i.e., 

H*(F(n,6- n u,D),A u ) -t as n ->• oo, 

for all ui £ ft and nonempty bounded subsets D of M, and (iii) is the minimal 
family (under inclusion) satisfying (i) and (ii). 

Definition 4.3. A cocycle F : Z + X f2 X M — > M is called uniformly dissipative if 
there exist a number Nd £ 1> + and a closed bounded set Mq C M such that 

F(iV rf , w, M) C M , VweSl. (7) 

Definition 4.4. A cocycle F : Z + x fi x M — > M is called uniformly contractive if 
there exist a number 7V C 6 Z + and a number A £ [0, i) such that 

p(F(N c ,u>,x),F(N c ,u,y)) < Xp(x,y), Vwgfl, x,y £ M. (8) 

We can now formulate an abstract theorem on existence of a random attractor. 

Theorem 4.5. Let F : Z + x f2 x M — > M be a uniformly dissipative and uniformly 
contractive cocycle. Then it has a random attractor si — {A^^lj £ D,}. Moreover, 
the set A u consists of a single point for each u> € f2. 

Proof. Fix numbers Nd, N c > I and A < 1 and a closed bounded set Mq for which 
(7) and (8) hold. 

First, it will be shown that for any bounded set D C M and any uj £ the sets 
F(n, 6- n ui, D) converge to some single-point set A^ as n — > oo. To do this, in fact, 
an even stronger statement will be proved: for any uj £ il the sets 

M„(w) := F{n,6^ n uj,M) 

converge to some single-point set A u as n — > oo. 

Note that for each oj the sets M n (u>) are closed as images of the closed set M 
under continuous maps F(n, 9- n u, •). Moreover, for any uj £ Q, the sequence of sets 
M n (ui) is nested under inclusion: 

M w+ i(«) C M n {uj), n>l. (9) 

Indeed, by (5) 

M n+1 {uj) := F(n + 1, 0_ (n+ i)W, M) = F(n, 0i(0_ (n+ i )t i;), F(l, 0_ (n+ i)W, M )). 

Clearly #i(0_( n+ i)u;) = 6- n uj and F(l,6_( n+ uuj,M) C M, so 

M n+1 (w) := F(n + 1, 0_ (n+1) a;, M) C F(n, 0_ n «, M) =: M n (u), 

and (9) holds. 
Set 

d n = sup diam(Af„(w)). 

It will be shown that 

d n +i < d n < diam(Mo), n > N d . (10) 
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The inequality e?„ +1 < d n follows from (9) provided that the both numbers d n+ \ 
and d n are finite. Thus (10) follows if it can be shown that 

dN d < diam(M ). 

This last inequality readily follows from the inclusion 

M Ni (u) = F(N d , Q_ Nd w, M) C M , 

which is a direct corollary of (7). 

The inequalities (10) are thus proved, but now they will be strengthened to 

d n +N c < Ad„, n > N d . (11) 

To prove this inequality note that by (5) 

M Nc+n (uj) = F(N c + n,e_ (Nc+n) u,M) 

= F{N C , e n (e_ {Nc+n) u),F(n, 0_ {Nc+n) cj, M)). 

Here F{n, 9_ [Na+n) u, M) = M n (6_ Nc uj), so 

M Na+n {u) = F(N c ,9_ Nc u>,M n (6_ Nc Lj)) 

and, by the uniform contractivity of the cocycle F(n,w, x), 

diam (Mn c+71 {u)) < A diam (M n (8^N c ^ j) ■ 

Taking the supremum over all ui G £1 in the above inequality then gives (11). 

To finalize the proof of the theorem it remains to note that, for any given w € f2, 
the sequence of closed sets {M n (u})} is nested under inclusion and, by (10) and 
(11), the diameters of the sets M n (uj) tend to zero as n — >• oo. Then, by the Cantor 
Intersection Theorem (or Property), see, e.g., [20, Th. 13.65], the intersection 

A u = p| Af n (w) 

n>l 

is nonempty and consists of exactly one point. □ 

Remark 1. The proof of Theorem 4.5 implies that the component sets A u of the 
random attractor srf = {A^,uj G 0} satisfy the inclusion C Mo for all ugfl. 

Remark 2. To prove Theorem 4.5 it would suffice to require that (8) holds only 
for x, y € Mo, provided that the cocycle F is uniformly dissipative. 

Remark 3. It would be preferable to formulate properties of dissipativity and 
contractivity for a cocycle not in terms of the map F(n,x,y), but in terms of 
its generator f(uj,x). As will be seen below, in general, this is not possible in 
some interesting and natural applications, where the arising cocycle is uniformly 
dissipative and contractive, whereas neither the dissipativity for Nd = 1 nor the 
contractivity for N c = 1 holds. 

Remark 4. Theorem 4.5 has been formulated under rather severe assumptions. 
These can be essentially weakened, but serve perfectly well for the purposes of this 
paper. 
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5. The Hilbert metric and Birkhoff's theorem. To apply the results from 
Section 4 to linear cocycles generated by tridiagonal Markov chains (3), first recall 
some auxiliary facts (see, e.g., [5, 6, 16]) following the work [3]. 

Denote by the cone 1 of elements x = (x±,X2, • • ■ , xn) T € with nonnega- 

o 

tive components and by K + the interior of K^, which is clearly non-empty. Then 
the quantity 

■&{x,y) = inf {i: tx-yeK^} 

o 

is finite valued for any x, y € K + . 
Definition 5.1. The function 

( &(x,y) 



Pn{x,y) 



In 



is called the Hilbert projective metric (or, sometimes, the Birkhoff metric [16]). 

Remark 5. Definition 5.1 is applicable to cones in a general Banach space. For 
the cone in the finite-dimensional space R w , it can be shown to be equal to 



Ph{x,v) 



maxj y i jx l 
maxi Xi/yt 



(12) 



Ph(x, y) = max {In y t - In - max {In Xi - In y % } 

i i 

for vectors x = (xi,x 2l . . . , xat) t and y = (2/1,3/2, ■ ■ ■ ,Vn) T in K+. 
Observe that p^(x,y) satisfies the triangle inequality 

o 

Ph(x, z) < p H (x, y) + p H (y, x), x,y,z€ 

O 

whereas the relation p^(x*,y) = with x,y G does not implies the equality 
x — y. but only the equality x = ty for some t > 0. Moreover, 

o 

Ph(sx, ty) = p H {x, y), V s, t > 0, x, y € K+. 

o 

Thus, strictly speaking, pu{x,y) is not a metric on K,, but only a semi-metric. It 
becomes a metric, however, on a projective space. An important way to make it a 
proper metric is covered by the following theorem. 

Theorem 5.2. Let X C M. be a closed, bounded set such that ^ X and any ray 

o o 

{tx : t > 0} with x G K + intersects X in at most one point. Then (X n K + , pn ) is 
a metric space. 

Q 

Moreover, if any ray {tx : t > 0} with x G K + intersects X in exactly one point, 

o 

then the metric space (X n K + , pu) is complete. 

o 

Corollary 1. The interior Ejy of the probability simplex Sjy is the complete metric 
space with the Hilbert projective metric. 



1 Recall, see, e.g. [16], that a set K in a Banach space is called a cone if it is convex, closed 
and tK C K for any real t > 0, and K n —K = {0}. 
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Remark 6. In general, the set XnK* in Theorem 5.2 is unbounded in metric pn- 

o 

Convergence in the metric space (X n K + , pn) implies convergence with respect to 
any norm in M. N . 

Definition 5.3. A linear operator (matrix) L : M. N — > M. N is called nonnegative if 
L : K%, and positive if L : \ {0} K^. 2 

Definition 5.4. If a linear operator (matrix) L : M. N — > M. N is positive, then its 
projective diameter 5(L) is defined by 

S(L) = sup ^p H (Lx,Ly) : x,yeK+ 

and the contraction ratio >c(L) of L is defined by 

k{L) = inf | A : ph{Lx, Ly) < Xp H (x, y), x, y G 

Theorem 5.5 (Birkhoff). // L : K w — > M. N is a positive linear operator (matrix), 
then 

x{L) < tanh \^ S ( L ) \ < L 

Given a positive linear operator (matrix) L : M. N — > R denote by L(-) the 
(nonlinear) operator defined by 

L(x) = P(Lx), i £ Ejy. 

where P is the projection operator to the simplex Sjv defined by 

1 



P{x) = X, X £ 

X\ + x 2 + • • • + x N 



rN 



Theorem 5.6. L(-) is a contracting mapping with the contraction constant x{L) 

o 

on the metric space (En,Ph)- 

Remark 7. If the simplex Ejv is invariant for the positive linear operator L then 
the assertion of Theorem 5.6 can be simplified to: if L : R N — > M. N is a positive 
linear operator (matrix) for which LSjv Q ^n, then it is a contracting mapping 

o 

with the contraction constant >c{L) on the metric space (£jv, A/y). 

6. Attractors of linear cocycles with a tridiagonal generator. The result 
of Sections 4 and 5 will be applied here to the linear system generated by the 
tridiagonal Markov chains that were introduced in Section 2. 

Let Jz? be a set of linear operators L u : R N — > M. N parametrized by the parameter 
cj taking values in some set f2 and let {9 n , n 6 Z} be a (discrete-time) group of maps 
of f2 onto itself. The maps L^x serve as the generator of a linear cocycle 

F&(n,u>)x = Lg n _ iu) ■ ■ ■ Lg lLU Lg 0LU X. 

In particular, consider the case where 

L u := I N + AQ(w) (13) 

2 It is straightforward to show that a matrix L is nonnegative iff its components are nonnegative, 
and positive iff its components are strictly positive. 
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with the tridiagonal matrices Q{ui) of the form (1) for which the band entries qi 
depend on the parameter wgSl, i.e., qi = qi(u>) for i = 1,2,..., 2N — 2. 
In the sequel the following basic assumption will be used. 

Assumption 1. There exist numbers < a < ft < oo such that the uniform 
estimates 

a < q l {uo) < @, u6fi, i = 1,2, . . . , 2N — 2, (14) 

hold. 

Lemma 6.1. Let A < js. Then the entries of all of the matrices L^, ui € Q, are 

nonnegative, and thus 

cif, we n. 

Proof. This follows directly from the representation :— In + AQ(lu) and the 
form (1) of the matrices Q(uj). □ 

If A < i then 7 := min{Aa, 1 - 2A(3} > 0. Define the subset Sat (7) of the 
simplex Sjy as 

N 

Sjv(7) = {x = (xi,x 2 ,-.. ,x N ) : }^Xj = l, Xi,x 2 ,...,x N > 7 A '~ 1 }, 

i=l 

and the subcone $£^(7) of the cone as 

K?( 7 ) = {tx : t > 0, areEjvfr)}- 

Clearly 

K^( 7 )\{o}ci^. 

Lemma 6.2. Let A < ^ and 7 = min{Aa, 1 - 2A/3}. Then, 

Fj8r(JV-l 1 w)Ej V CE J¥ ( 7 ), weft, (15) 

and, hence, 

F^(JV-l, W )(lf\{O})ClJ r ( 7 )\{0}CKj r , 

Proof. Fix an w £ fl. By induction, it can be shown for each n = 1, 2, . . . , iV — 1 
that the matrix 

Fsf (n, w) = Lg n _ lU ■ ■ ■ Lg lU] Lg oLJ 

is (2n + l)-diagonal and that its components belonging to the main diagonal and 
to the first n sub and super diagonals are greater than or equal to 7™, while others 
vanish. Thus 

all components of the matrix F^(N — 1, lS) are positive and exceed 7 Ar_1 . (16) 
By (4) and (13) 

and (16) implies that 

F<e(N-l,u)E N CV N (>y)ch N , cjeil. 
The inclusion (15) is thus established. □ 
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Theorem 6.3. Let F^f(n,uj)x be the linear cocycle 

F^{n,u})x = Lg n _ lU) ■ ■ ■ Lg lu] Lg oLU X. 

with matrices L u := 1^ + AQ(lu), where the tridiagonal matrices Q(oj) are of the 
form (1) with the entries qi = qi(u)) satisfying the uniform estimates (14) in As- 
sumptiom 1. In addition, suppose that A < Jg. 

Then, the set is invariant under F^(N — 1, u>), i.e., 

Fsf(N-l,u})E N CE N , u>efl. 

Moreover, the restriction of F^{n,ui)x to the set Tin is a uniformly dissipative 
and uniformly contractive cocycle (with respect to the Hilbert metric), which has a 
random attractor srf = {A u ,uj £ f2} such that each set A u , ui € Q, consists of a 
single point. 

Proof. Under the assumptions, 7 := min{Aa, 1 — 2A/3} > 0. Define 

S = sup {p H {x,y) : x, y G Eat (7)} ■ 
It follows by formula (12) for the Hilbert metric in K^f that S < 00, so 

x < tanh (-6) < 1. (17) 



Hence, by Lemmata 6.1 and 6.2, for each lu £ £1 the matrix F^(N — 1, uj) satisfies 
the conditions of Theorem 5.5 and is thus uniformly contractive in the metric space 

o 

(Y<n,Ph) with the contraction constant h. Moreover, by Lemma 6.2, each of the 

o o 

matrices F^(N — l,ui), uefl, maps the set Eat to the set Eat (7) C Eat, which is 
bounded in the Hilbert metric pu- 

o 

Setting M = Ejv and p = p H , M = Sat (7) and Nj = N c = N - 1, it follows 
that all of the conditions of Theorem 4.5 are satisfied. Hence the restriction of the 

o 

cocycle F&{n,w)x to the set Eat has a random attractor srf = € fl} such 

that each set A u , 10 £ CI, consists of a single point. 

To complete the proof it remains to note only that due to Lemma 6.2 all the 

o o 

matrices F^(N — l,u>), ui € Q, not only map the set Eat to the set Eat (7) C Eat, 

o 

but also map the larger set Ejv to the set Eat (7) C Eat- Hence, the family of sets 
stf = \A^,ui G tt} is a random attractor for the cocycle F^(n,ui)x considered not 

o 

only on the set Eat, but also on its closure Eat. □ 

Remark 8. The proof of Theorem 6.3 implies that the component sets A^ of the 
random attractor srf = {A u ,u 6 51} satisfy the inclusion A^ C Eat (7) for every 

uj en. 

Henceforth write A u = {a w } for the singleton component subsets of the random 
attractor si ' . Then the random attractor is an entire random sequence {ag nU , neZ} 

o 

in Ejv (7) C Eat, which attracts other iterates of the random Markov chain in the 
pullback sense. Pullback convergence involves starting at earlier initial times with 
a fixed end time, see [7, 15]. It is, generally, not the same as forward convergence in 
the sense usually understood in dynamical systems, but in this case it is the same 
due to the uniform boundedness of the contractive rate with respect to u>. By (17) 

x{Lj) < v :— tanh (-6 J < 1, Vw£ Cl. 
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Now let p^(uj) be the nth iterate of the random Markov chain (2). Then 

PH (p {n+1) (oj),ae n+lU ,) <v P h (p (T °M>«*„«) 
for all n > and every u) G f2, since 

p n+1 {uj) = ie iiW p (n) (o;), ae n+iul = Le nUJ ae nU . 

Hence, 

p H (p (n) (w), < v n p H (p(°\a u ) 

for all n > and every w G f2, from which follows the pathwise forward convergence 
with respect to the Hilbert projective metric. 

Ph (p^ n \uj), ae„Sj -> as n -> oo, Vw6fl. 

By Remark 6, convergence in the Hilbert projective metric implies convergence in 
any norm on R . This gives 

Corollary 2. For ant/ norm || • || on l w , p(°) G Sjv afid w G Q 



p^(uj)-ag n 



— > as n — > oo, Va; S 



The random attractor is, in fact, asymptotic Lyapunov stable in the conventional 
forward sense. 

6.1. Deterministic nonautonomous Markov chains. The above proofs make 
no use of probabilistic properties of the sample path parameter uj (apart from T- 
measurability considerations, which are not an essential part of the proof). It applies 
immediately to deterministic nonautonomous Markov chains in which the transition 
probabilities vary, say, periodically in time. 

As described in [15], this time variation can be modelled by letting uj be an bi- 
infinite sequence uj — (oJ n )nez € A z , i.e., with u n G A, n 6 Z, for some compact 
metric space (A, p\). Then = A z is a compact metric space with the metric 

Pq(uj,Q) = ^ 2~ |n| /9A(w„,a) n ) 

and the shift operator 9(u) n ) n £z = (w n +i)nez is continuous in the metric pn- It 
turns out then that uj t— > a u is continuous here (in general, the set-valued mapping 
uj i — ^ is only upper semi-continuous) . These topological properties of the driving 
system replace the measurability properties in the random dynamical systems. 
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